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!. INTRODUCTION 


A. PURPOSE OF THIS STUDY 

The purpose of this study is to examine two methods of statistical sampling 
which may have apphcation in assisting government price analysts and contract 
negotiators in expediting processing of proposals for change orders. The study will 
describe how and why the use of statistical sampling mav expedite proposal negotiation 
while maintaining acceptable levels of msk, and will determine which of the two 
sampling methods examined provides more acceptable results under the given 


conditions. 


B. NEED FOR THIS STUDY 

Current defense acquisition procedures often involve situations in which 
Department of Defense (DOD) agencies must deal with a sole source supplier in 
obuving material or services. In major weapon system acquisitions for example, the 
Department of Defense typically issues a large number of change orders to modifv an 
existing contract. A lead ship or aircraft production contract mav generate over 10,000 
change orders. Whv must such a large volume of change orders be issued? After a 
orime contract is awarded and production begins, design changes are often necessitated 
ov a change in performance requirements requested by the government or by unforseen 
technical problems which almost always seem to crop up. Each design change requires 
a modification to the prime contract called a change order. In each case, the 
contractor prepares a proposal reflecting his estimate of what the requested change will 
cost. The two parties (government and contractor) must then negotiate a price tor 
each change; and, because the prime contractor is the logical one to incorporate the 
requested change, there is no competition to help assure that the government receives 
the fairest possible price. The onivy mechanisms working to assure a fair price for the 
change order are the adequacy of the contractor's estimating procedures, the 
contractor’s inherent honesty and desire to provide a good product at a fair price, and 
the analvsis of the proposal by government price analysts. 

Federal Acquisition Regulations (FAR) require the government to analyze each 
proposal prior to negotiation to assure that the proposal represents a fair price. [he 


analysis and negotiation of costs for each proposal is done by some cognizant 


government agency. Often, a group of government employees have been assigned to 
perform such functions in residence at the contractor's plant. The volume of work 
thus generated and the amount of money involved are quite substantial. This volume 
of work combined with a lack of sufficient numbers of government analysts leads to 
large backlogs of unprocessed proposals. To perform a really thorough analysis and 
patient negotiation takes much more time than government analysts are currently able 
to give to a proposal. If analvsts do trv to take more time and be more thorough, they 
fall still farther behind as the backlog continues to grow. Therefore, there is 
tremendous pressure on analvsts to expedite their work even though it is generally 
recognized that hurried analvsis and negotiation can result in costly overpayment since 
juickness commonly works against thoroughness and accuracy [Ref. 1: pg. 2]. 

Unprocessed proposals can result in extra expense for the contractor too. In 
many situations involving ongoing production or repair work, the proposed work is 
begun before the proposal is analyzed and negotiated to avoid expensive delay and 
disruption costs. Tne contractor, however, except for partial advances called “progress 
payments’, 1s not paid until after the proposal is processed. Because of this, the 
contractor mav have to borrow working capital to cover funds tied up in the backlog 
thus suffering capital costs. 

[t is generally recognized that it is in the best interest of both parties to expedite 
the processing of the proposals without sacrificing accuracy. If allowed bv the 
regulations, analyzing and negotiating a sample of proposals selected with an effective 
statistically-based sampling technique could have these effects. If a suitable sample of 
proposals were selected from the backlog and carefully analyzed and negotiated, the 
resulting data could be extrapolated to estimate what the results would have been had 
every proposal received the same treatment. 

The reason for auditing the proposal population is to ensure the proposals reflect 
costs that are fair and reasonable. During an audit the government analvst will find 
that one of three possible conditions exists. First, the governmient may feel that the 
proposal has been understated, i.e., the contractor's proposed cost for a change to the 
contract ts less than the actual cost the contractor will incur. Second. the government 
may conclude that the contractor's proposal is overstated. Third, the audit findings 
may conclude that the proposal is reasonable. Any overstatement or understatement is 
considered to be an error in the prcpcsal population. A sampling technique wnhicn 


allowed no sampling error (with sampling error being defined as the chance that a 





sample which is statistically selected and evaluated will lead to the wrong conclusion or 
to an inaccurate projection) would select a sample from the population of proposals 
which, when audited, would always give an estimated value for the population as a 
whole which was exactly correct, no matter what the degree or distribution of errors in 
the proposal population. Since sampling errors are due entirely to chance and are 
inherent in any sampling process, we cannot expect a sample of “n” proposals from the 
proposal population to provide an error-free characterization of the “N” proposals in 
the population. 

PScOuunemtaen, tadtapmere will be some degree of error in the prediction of the 
true value of the entire proposal population whenever a sampling technique is used; the 
behavior of the degree of error must be predictable and exhibit certain qualities in 
order for the sampling technique to be considered appropriate for the purpose 
described above. 

Specifically, the degree of error should not be easily altered by the distribution, 
size, or type (overstatement, understatement) of errors found in the population. If 
certain patterns of errors caused the entire population to be evaluated as understated 
then the government would pay more than a fair price for the changes described by the 
population of proposals which contained those errors [Ref. 2: pg. 7]. Since both parties 
to the negotiation would have to enter into a binding agreement to abide bv the results 
of using statistical methods, all aspects of the sampling and estimation process must be 
disclosed in advance. With this necessary advanced knowledge, a shrewd contractor 
could carefully seed his proposal population with deliberate errors of the appropriate 
size, type, and distribution and thereby be awarded a larger payment from the 
government. 

Therefore, the desired sampling technique will not necessarily be the one which 
results in the most accurate, average estimate for various error arrangements in the 
proposal population. I[t will instead be the method which responds least to variations 


in the arrangement of errors. 


C. METHODOLOGY 

As mentioned previously, the purpose of this study 1s to examine the effectiveness 
of two sampling techniques that appear to be most suitable for the purpose of 
analyzing contract change orders. Tne two sampling techniques to be studied are 
Stratified Random Sampling and the Basket Method. In this study, the two methods 


will be used to draw samples from populations for evaluation. The populations were 


previously used in a joint study of the American Institute of Certified Public 
Accountants and the American Statistical Association [Ref. 3]. The data consist of two 
columns of values which represent the proposed, or book value of a contract change 
and the audited or true value of the change. The populations are ngged with either 
random or planned errors. The samples drawn bv the two methods from each 
population will be evaluated and compared to determine which method gives a better 
estimate of the whole population according to the goals described above. Both the 
error rigging and evaluation steps are exrlained further in the description of the 
simulation. 

The amount of work associated with auditing is more closely correlated to the 
number of items being audited than to the total dollar value of all the items being 
audited. Therefore, the sampling rules of the two methods will be adjusted so that thev 
wil draw samples with the same number of proposals from each population. The 
results of this study will then indicate which method yields the more desirable 


prediction while holding the cost of the audit constant. 
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lj. THE BASKET METHOD 


A. HISTORY 

The “Basket Method” of sample selection was developed by Dr. K. T. Wallenius. 
Professor of Mathematical Sciences at Clemson University. Development of the 
Basket Sampling method was sponsored bv the Office of Naval Research and Naval 
Material Command and funded by the Office of Naval Research under its Acquisition 
Research program. The Basket Method was developed as a potential tool to assist 
orice analysts and contract negotiators in expediting processing of proposals for change 


orders when dealing with a sole source supplier. 


B. DESCRIPTION 

The name “Basket Method” is derived from the manner in which the population 
IS partitioned into separate groups (baskets) prior to randomly selecting one of the 
baskets as the sample. The goal of partitioning the population into baskets by the 
basket assignment process is to make each basket a good representation of the 
population as a whole. It must be stressed at this point that “representative” should be 
thought of in terms of bid prices onlv.! Because each basket is representative of the 
population as a Whole, the spread and proportion of proposal values will be nearly 
identical to those of the population. Therefore, it makes no difference which basket 1s 
selected to be audited in detail. The following example will describe the use of the 
basket method technique. 

i. Basket Assignment 

Imagine having a population of 100 proposals (N= 100) from which a 10°%% 

eeplcm m0) 1s)to be selected. The proposals are then arranged in order of 
decreasing bid price and numbered accordingly; that is, the proposal with the largest 
bid price is number |, the second largest number 2. and so on. The proposals are now 
ready to be separated into 10 different baskets. Starting with proposals | through 10 


(those with the largest bid prices), one proposal is placed in each basket. Each 


‘Tt is realized there may be other relevant factors besides bid price that should be 
Semsidercd im the definition of representative’. For the purposes of this paper, 
however, it will suffice to sav that sophisticated software can quickly balance baskets 
for type of work, degree of labor intensity, level of technology, etc. In short, whatever 
characteristics are identified as potentially important to the value of an audit will be 
“balanced” by the basket method where possible. 


1] 


successive group of 10 proposals are assigned, one-per-basket, using the following rule: 
the largest unassigned proposal is placed in tne basket with the smallest sum of bid prices. 
For the second group of 10 proposals, this rule results in pairing proposal 11 with 10, 
12 with 9,..., and 20 with 1. Basket subtotals are then calculated and the assignment 
rule applied to the third group of 10 proposals. This is repeated until all the proposals 
have been assigned. [Ref. 1: pg.10] 

Due to the dalancing of basket totals at each stage of the basket assignment 
process, the resulting assignment should result in nearly equal basket totals. Should 
additional balancing be required, the previously mentioned computer program can be 
used (via a swapping algorithm} to bring basket totals into closer agreement. 

2. Estimating Negotiated Prices for Unsampled Proposals 

After the baskets are formed. one is selected at random and all its proposals 

are audited and negotiated. Using the results of the sample negotiation, the sample 


Tacio factor, R, 1s computed as im equation 20 
R = Total negotiated price of sample'Total bid price of sample (eqneZzam 


The total proposal value of the population is then multiplied by the samiple ratio 


factor, R, to determine the population audit result. This value will be the estimazred 


true value of the population.” 


"The sample ratio factor could also be applied individually to each unsampled 
proposal, the values summed and the total added to the sum of the negotiated values 
of sampled proposals. The result would be the same. 


|? 





Wi. STRATIFIED RANDOM SAMPLING 


A. THE CASE FOR STRATIFICATION 

Stratified random sampling is similar in manv respects to the technique of 
unrestricted random sampling.? The major difference is that the population is divided 
into two or more groups (strata), each of which is then sampled separately. The results 
can then be combined to give an estimate of the total popuiation value. 

The primary oojective of stratification in auditing is to reduce the impact of the 
population variance on the sampling plan. Basically, a population of heterogeneous 
items (a population with large variance) is broken into two or more groups or strata of 
a more homogeneous nature (groups with small variances). The total population 
Variance is unaffected by this process. However, it should be intuitively clear that 
Within each group so constructed, the strata variance will be smaller than the 
population variance. [Ref. 4: pg. 149] 

To ulustrate, suppose a population consists of seven items--five have a value of 
Sl each. and two have a value of $3 each. The variance of this population is close to 
Sl, but by forming two strata with the five items vaiued at SI each in one stratum and 
the remaining two items of value $3 in the other stratum, the variation of each stratum 
is QO. This reduction in variance by the formation of two strata has important 
implications for the amount of sampling error and the size of the sample required. The 
relationship can be summarized as follows: Given any population of size N, the lower 


+ and 


the variability, the smaller the sample size required to achieve anv given precision 
reliability? Ge Minements, INC op aero]. 

While the above example is very simplistic and hypothetical in nature, it does 
illustrate the fact that by taking a relatively heterogeneous population and dividing it 


upd into homogeneous groups the variance of each group will be smaller than that of 


>The principle involved in unrestricted random sampling is that every element in 
the population should have an equal chance of being included in the sample. Since 
“randomness” 1s difficult to achieve without some kind of aid, a random number table 
Or a computerized random number generator are often used to insure random selection. 


*The range within which the true answer most i:Kely falls. 


S-y- : : “ : : ; ; : : 

“The likelihood that tne true answer will fall within the established range. [t 1s 
usually expressed as a percentage, being the number of times out of one hundred that 
the true answer would be contained within the determined margins. 
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the original population. As a result, the sample size required will be smaller than if 
unrestricted random samples were taxen; or alternatively, the reliability wouid be 
higher or the precision limuts narrower. Stratification should therefore ve applied to 
heterogeneous populations which can be divided into fairly uniform strata on the basis 
of some criteria that affects the variable being studied. Under these circunistances, 
Stratification usually achieves greater precision for a given cost. On the other hand, 
Stratification 1s unnecessary in homogeneous populations where there are no discernible 
Strata that will affect the results. 

To use stratified sampling, three general rules must be adhered to [Ref 6: pg. 96); 


1. Every element nmiust delong to one and Onigone stn mmr 


tJ 


There must be a tangible, specifiable difference that defines and distinguishes 
the strata. 


The exact number of elements in each stratum must be known. 


or 


B. DESCRIPTION OF STRATIFIED RANDOM SAMPLING 

Once the decision has been made that stratification would be beneficial in the 
sampling process, there are several steps that must be taken. These steps will be briefly 
discussed below. 

1. Establish the Desired Precision and Reliability 

Statistical samples are evaluated in terms of “precision,” which is expressed as 
a range of values, plus or minus, around the sample result, and “reliability” (or 
confidence), which is expressed as the proportion of such ranges from all possible 
simular samples of the same size that would include the actual population value. 
[Ret ec) 

Basically, the statistical measures of precision and reliabilitv have to do with 
how accurate and reliable the sampler wants his sample results to be. An example of 
the application of these two measures 1s helpful in understanding the concepts. 
Suppose an auditor 1s designing a statistical test based on a desire to obtain an 
estimate of an audited account value to within $10,000. The $10.000 amount reflects 
the auditor’s judjment as to what would constitute a material deviation in reported 
values. In other words, the auditor does not want his estimate of the audited account 
value to be greater than $10,000 (either plus or minus) away from the true audited 
account value. Reliability is a closely related concept. The auditor's goal is not only 
to obtain an estimate within the materiality limit of $10,000 but also to be reasonably 


sure that this estimate is sound. Because only a sample is observed judgmentally or 
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statistically in most audit situations, certainty is impossible. Generally accepted 
auditing standards recognize this by requiring reasonable assurance rather than 
certainty. Reliability is the statistical measure of that level of assurance stated as a 
proportion. For example, a proportion of 0.95 indicates that the auditor wishes to 
achieve a 95% level of reliability that the reported amount is not materially different 
(plus or minus $10,000) from the audited amount. 

Specification of a probable range for a population parameter--a plus or minus 
for error--is crucial in indicating the reliability of estimates. This process involves the 
construction of a confidence interval for the population parameter being estimated. An 
in-depth look at confidence level construction is bevond the scope of this study 
however, and it is suggested that the reader consult any good statistics textbook for a 
detailed discussion of this topic. For this study, no specific precision and reliability 
levels will be set: the purpose of this study being to compare the results of the two 
sampling methods to each other rather than to attain some specific level of accuracy 
and reliability. 

2. Designate the Strata and Straia Boundaries 

For all practical purposes, there is currently no existing wavy to select the 
optimal number of strata or the strata boundaries [Ref. 4: pg. 158]. Useful rules do 
exist. however. Ideally, the auditor prefers to base stratification decisions on the 
specific variable of interest. In most audit applications, the variable of interest is the 
number of audited account values. There is a problem here, however. in that the 
nuniber of audited account values is not actually known until after sampling. 
Fortunately, a good substitute for audited account values--reported account 
values(book values)--1s usually available. The auditor generally expects a reasonably 
high correlation between the available reported account values and the obtained audit 
account values. and can be reasonably confident about basing stratification decisions 
on the available unaudited reported account values. However, this does limit the 
benefits of stratification in that, all other factors being equal, unless the correlation 
between reported and audited account values is perfect, the errors introduced by a 
particular audited account value belonging to different strata than the related reported 
account values wul eventually negate any further benefits that can be obtained by the 
acdition of new strata. 

It is probably somewhat clear bv now that, from a practical viewpoint, the 


identification of strata is a heuristic process (a sort of educated guess). In an auditing 


context, the approach that is most likely to be beneficial is to obtain some idea of the 
underlying character and distributional properties of the population of reported 
account values (bock values). This can be done manually, but the results are much 
more meaningful when a computer can be utilized. The various output obtainable 
from a computer, along with a basic understanding of the data, mav enable the auditor 
to subjectively select strata of a reasonable nature. In some cases, the data may lend 
themselves to obvious strata divisions, but in most situations this will probably not be 
inexcase. 

Even if there are a certain number of obvious strata, say two, there are further 
questions to be asked. For example, if the use of two strata contribute to a substantial 
decline in the population variance, one might reasonably ask, “If two strata gave good 
results in reducing variance, wouldn't the use of four strata give results that are twice 
as good”? The answer is, although an increase to four strata might also be beneficial, 
it Would probably not lead to as large a reduction in the variance estimate. in fact, 
such diminishing returns are observed as the number of strata increases. [emis 
doubling of strata--from one to two--can produce variance reductions of as much as 
60° or 70% [Ref. 4: pg. 159]. However, a second and third doubling tend to curtail 
the incremental reductions to about 25% [Ref. 4: pg. 139]. Therefore, theremisusemre 
point at which the addition of more strata will no longer be useful in reducing variance 
estimates, and mav in fact increase variance. The only practical way to establish the 
limits of strata benefit is by computer simulation. As a general rule, 5 to 10 strata 
usually acccunt (depending on the particular population, of course) for most of the 
available variance reduction. 

Given the number of strata, the auditor must then determine how and where 
to set strata boundaries. Ideally, strata boundaries should be estabiished on the basis 
of audited account values, as before. But when these amounts are not available, 
reported (book) account values are conimomly used as the basis for setting most 
boundary values. This substitution will work well if reported account values and 
audited account values are closely correlated. 

Strata boundaries might be set using the egual dollar value per strata rule, 
which, as the name implies, means arranging the strata boundaries such that each 
strata has approximately the same dollar vaiue; or, boundaries might ode established 
based on the equal variance rule where each strata has approximately the same variance 


Measure, 
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PmoOlvcwmiiemmsamiciimes referred "row as “the O-SUY or CUSUM rule. 
establishes the strata boundaries by first creating a frequency distribution of the 
recorded (book) account values. The square root of the frequency of recorded account 
values in each category is then computed and summed and the resulting total is divided 
ov the desired number of strata. The auditor atiempts to create strata by accumulating 
the scuared frequency measures in sequence until the cumulated sum (CUSUM) ts 
approximately equal to the total accumulation divided by the number of strata. The 
next strata is then composed of the next grouping in the sequence such tnat the 
CUSUM is approximately equal to twice the total accumulation divided by the number 
of strata. [Ref. 4: pg. 161] 

For this study, the population will be divided into 10 strata based on the book 
value amount of the audit unit. Stratification by book amount 1s helpful when the 
book amounis of the audit units are reiated to their audit values (Ref. 3: pg. 77]. The 
choice of 10 strata was made to facilitate comparison with the Basket Method in that 
10 “baskets” will be used when applying the Basket Method in this study. 

Strata boundaries will be set using the equal dollar value per strata rule. 
Again, this rule is used to facilitate comparison with the Basket Method where basket 
totals are nearly equal due to the unique basket assignment process. [t mav seem that 
Paine CCUd G@llanesvaluesner Strata rule is used that, conceptually, there is no 
difference between the “strata” formed under Stratified Random Sampling and the 
“oaskets’ formed using the Basket Method. There ts in fact a significant difference that 
stems from the distinctive wavs in which the strata and baskets are formulated. Under 
the Basket Method, the population is partitioned into baskets in such a way that each 
basket will have approximiately equal dollar value and contain approximately the same 
number of individual elements. Under the Stratified Random Sampling Method, strata 
are also partitioned so that they contain approximately equal dollar value but the 
number of individual elements in each strata mav vary drastically. 

3. Sample Size Determination and Allocation 

Two methods are generally used to allocate a total sample to individual strata 
[Ref. 6: pg. 97}. One method 1s Known as proportional allocation. \n this method, the 
percentage of the sample allocated to each stratum is the same as the percentage of the 


total popuiation accounted for by that stratum. That is, 


ao; Seles PHS (eared) 


ke 


where n, represents the sample size for the ith stratum, n the total sample size, Note 
number of popuiation items in the ith stratum, and N the total population size. 

A generally more effective method, however, is gptimal allocation. Optimal 
allocation allocates the total sample to the individual stratum on the basis of the 


on 


relative” stratum size, N, and the stratum standard deviation, SD. 
= x j bros 
n =n X NSD, oNSD. {eqn 3.2) 


In equation 3.2, SD, represents the standard deviation of stratum i. All other variables 
are (he Same as im equations. 

Although the optimal allocation method is generally more effective, the 
proportional allocation method will be utilized in this study. Proportional allocation 
will give more meaningfui resuits (for comparison with the Basket Method) for this 
investigation given that strata boundaries are being set using the “equal dollar value 
per strata rule.” If optimal allocation were used, in two strata the sample sizes 
caiculated using equation 3.2 would be greater than the total number of elements in the 
strata. If this were to happen in a real world sampling situation, each affected strata 
sample size would be set equal to its population size and sample sizes would be 
recalculated for the remaining strata. The saturated strata would then be audited 100 
percent. To do tnis for this studv would not facilitate comparison of the two methods 
of sampling under “like” circumstances. 

The sample size computations depend on whether the optimal or proportional 
aliccation method is used. There are equations to be used for each metnod in 
calculating the appropriate sample size required to achieve a stated level of precision 
and reliability. The equations will not be enumerated here because sample size 
requirement calculations are not required to be made for the purposes of this study. 
This 1s because in actual applications where the true value of the population is not 
known the only way to be reasonably certain that one’s results are valid :s by 
coniplying with rules which will tie the audit to statistical theorv. The sampting rules 
for Stratified Random Sampling are designed to do just that, so that the auditor who 
follows the sampling procedures wili be able to determine the extent of the audit 
required to achieve the desired leveliot cetiamime 

In this study the true values of the proposals are known, as are the size and 


distribution of errors, and the Stratified Random Sampling metnod is not being 





compared to its theoretical limits, but to a second method to determine which of the 
two is the more desirable in a certain case. The sample size is this studv will be chosen 
arbitrarily, and is further described in the Description of Simulation section. 


4. Select a Random Sample of Size n. From the Strata 


Cn 


. Calculate the Mean of Each Stratum Based On n for each Stratum 
. Calculate the Estimated Audited Population Total 


Om 


This calculation involves taking the mean of each stratum (derived in step 5 
above), multiplving it by the total number of items in the stratum and then summing 
the results. This gives the estimated audited population total which can be 


mathematically represented as follows: 
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(eqn 5.3) 


Where X, represents the mean of stratum 1, N., the total number of items within stratum 
1, and * X.N. the sum of ( X,N.). 
7. Check Reliability of the Estimated Audited Population Jotal 
This step involves concluding that one 1s certain at the reliability specified in 
Step | that the true book value is within the estimated audited population total plus-or- 


minus the achieved precision.° 


There is a formula which can be used to calculate the achieved Precision, = Ne 
achieved precision shouid always be less than or equal to the desired or acceptabie 
precision. Ifthe achieved precision is greater than the acceptable precision, the sample 
BmeniseUlisiliiicient because the precision limit is too wide. If this were the case the 
Sampie sizc would have to be increased. 


fe 


IV. DESCRIPTION OF SIMULATION 


A. DERIVING COMPARABLE RESULTS 

As menuoned previously in this paper, the desired sampling technique is not 
necessarily the one that results in the most accurate, average estimate for proposal 
populations with varving error arrangements. A more important characteristic of the 
desired method will be that it responds least to variations in the arrangement of errors. 
In other words, it will be the method which is more consistent in its predictions over 
Various error arrangements and patterns. Since it is the consistency of the drawn 
sample which is of interest in this investigation, the sample selection process of both 
the Basket Method and the Stratified Random Sampling Method will be used to draw 
samples from the same populations. The samples will then be evaluated according to 
the basket method, which will give an estimate of the true value of the populaim@messs 
see how well each method's sample reflected the value of the population: 

The rules of the basket method will create the identical set of baskets froma 
given population every time they are applied. Therefore, the “baskets” of thesimeies 
method can easilv be evaluated bv a complete review of the specific results. The rules 
of the Stratified Random Sampling technique also provide a finite number of sainples. 
but that number 1s significantly greater than the number of different baskets. 

To evaluate the sample drawn with the Stratified Random Sampling pulesmae 
sample is treated as if it were a basket. Then, the sample is evaluated using the basket 
method evaluation technique; that is, all of the sample's resident proposals are audited 
and their true value is divided by their proposal value. The resulting factor is 
multiplied against the population proposal total to determine the best estimate of the 


true total value of the proposal population. 


B. CREATION OF THE TEST POPULATIONS 

Using the general purpose statistical computing system Minitab, the original 
population was seeded with errors at a 5% and 10% rate of occurrence in a random 
distrioution. The 5% error population (population A ) was then skewed to form two 
additional test populations. One (population B) had its errors skewed strongly to its 
higher valued proposals, and the other (population C) to its lower valued proposals. 


The total dollar amount of error and number of overstated proposals remained 





constant during the skewing procedure. All populations were created in both a 
“dishonest” version which had overstatements only and are named with single letters 
(populations A.B,C,D, and E), and in an “honest” version with both overstatements 
and understatements named by double letters (AA,BB.CC.DD, and EE). Except for 
the sign on each error, the single letter named populations are identical to their double 
letter named counterparts. Therefore, populations AA, BB, and CC differ from their 
single lettered counterparts only in the fact that they contain both errors of 
overstatement and understatement. The populations with 10°% errors differ in that E 
and EE, while containing the same number of errors in the same distribution and sign 
as D and DD respectively, have errors of much larger magnitude, so that the sum of 
the dollar value of the errors make up 10% of the population in E and EE but only 


1% of the population in D and DD. The populations are described in Table 1. 


Jes BD LEal 
POP OE TION DESC KTR 


NAME A B S D iP 
Population § 300 § 300 oh CLOG § 300 8,300 
Erroneous Proposals 5% 5% 5% 10% 10% 
Pee se TrOrs.2. ) Proposals 9% 9% 9% 1% 10% 
Miieeceo: irons ale ie a te a5 
Skew (none, high, or low) N H ly N 
NAW LE AA BB aC DD fee 
Population 8,300 8.300 8,300 8,300 $300 
Erroneous Proposals 5% 5% 5% 10% 190°% 
mes Errors S Proposals 9% 9% 9% 1% 10% 
in esecieetrors {2c + /. + /- + /- +. 
Skew (none, high, or low) ~~ H L N N 


C. SIMULATION EXECUTION 
Simulations were run on all populations using both a Basket Method evaluating 
program and a Stratified Random Sampling procedure which was done manualiy 


within Minitab. The Basket Method program utilized was written by Lieutenant James 


P. Tortorelli for use in his thesis at the Naval Postgraduate School [Ref. 2: pg. 13}. 
This program, written in Waterloo BASIC, is listed in Appendix A. The Stratified 
Random Sampling simulation process is detailed in Appendix B and consists cf the 
following basic steps. Each step is referenced bv line number to its actual application 
in Appendix B: 
L. Stratify the Population 

(Appendix B line numbers 6 - 45) 
. Allocate the Total Sample to the Strata 

(Line numbers 45 - 80) 


ty 


(yd 


Seiect a Random Sample From Each Strata 

(Line numbers 8&1 - 130) 

4. Calculate the “Book Value” sum for Audited Items 
(Une munmibens ole oe) 


Calculate the “Audit Value” sum for Audited Items 


can 


(Line numbers 134 - 136) 
6. Calculate the Correction Factor 
(Line numbers 137 - 139) 
. Calculate the Predicted Population Audit Total 
(Line numbers 140 - $42) 
8. Calculate the Percent Error 

(Line numbers 143 - 148) 

As mentioned earlier, ten baskets were arbitrarily chosen for the Basket 
\fethod; this resuiited in 830 proposals per basket. Ten strata were then chosen for the 
Stratified Random Sampling Method with a total sample size of S30 to be selected. 
Strata boundaries were set using the “equal dollar value per strata” rule; therefore, each 
Strata has approximately the same total dollar amount contained within it. This rule 
was used because it allows better comparison with the Basket Method in that each 
“basket” formed under the Basket Method sample selection process has nearly equal 
Gollar basket totals. Ten trials were run using the Stratified Random Sampling 
selection method. 

The ten audit results for each sample selected by the two methods were then 


divided bv their respective proposal sums to derive the correction factors as follows. 


F = Total audit sum of sample:Totai proposal sum of sample (eqn 4.1) 


to 
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These correction factors were multiplied by the sum of all proposals to derive the 


predicted true audit total for the population. That is, 


Pe | =" xX PSUM (ean 4,2} 


where PTAT represents the predicted true audit total for the population, F. the 
eorrection factor, and FSU ™M the sum of all proposals. The difference between the 
predicted true audit total anc the actual audit total was then divided by the sum of all 
proposals to give a percent error for each basket and trial. This calculation can be 


mathematically represented as follows: 


PE = (PTAT - AAT)-PSUM (eqn 4.3) 


Paine Cw emresents percent cIrot, | |All, the predicted true audit total for the 
population, AAT, the actual audit total for the population, and PSUM the sum of all 
proposals. The mean percent error for each method was then calculated in the 


following raanner: 


VIPE = SPE/10 (eqn 4.4) 


fonere Vil ee represents tie mean percent error and SPE the sum of the individual 
percent error amounts for each trial. The mean percent errors for each method by 


population are listed in Table 2. 


TABLE 2 
Dive PATON RES Ciba Vises ERROR) 


NAME A B C D E 
Basket Method .770 37] as. O89 629 
SRS -.§9§ 1.011 as -.078 -, 639 
NAME AA BB Ce DD EE 
Basket Method IO] OS 1.099 065 ye 


SHS) -.936 ees) 1567 -.105 ere 


Detailed resuits are shown in Appendix C. A positive percent error represents 
an overestimate and a negative percent error represents an underestimate. With the 
exception of population D, the Basket Method of sample selection was alwavs more 
accurate with overstatement errors. For the populations with both overstatement and 
understatement errors, the Basket Method was more accurate across the bOaTdueieee 
data trom Table 2 are perhaps more vividly illustrated when expressed in a different 
manner. The Basket Method errors are expressed as a percent Of the /Simugem 


Random samiouns errors imei gles: 


TABLES 


BASKET METHOD ERROR AS A% 
OF STRATIFIED RANDOM SAMPEING ERROR 


NAME A B SS D E 
Percent SS 56 92 Li4 95 
NAME AA BB CC DD Ee 
Percent 96 68 SO 6] 79 


The average or mean value (in this case mean percent error) in aaesomem 
Measurements is only one important summary figure. I[t is also important 10 
ummarize the extent to which values differ among themselves or about a central values 
One of the most useful statistical measures of variability is the standard deviation. 


This measure is based on the concept of deviations from the mean. The deviation of a 


sampie measurement v, from its mean Y 1s defined as (y. ¥). The standard 
ceviation of a sample of “n” measurements y), ¥5.-..,. ¥, 18 defined to be the square 


root of the sum of the squared deviations divided by (n- I). The standard deviationgis 


can oe denoted as follows. 


5 = YG. yen - | (eqn 4.5) 


As previously mentioned, the measure of standard deviation may be used to show the 
devree of variation among values in a given set of data, or it may be USedmite 
supplement an average to describe a group of data. [It also may be used to compare 


ene group of data with ancther. When the standard deviation is high, the average 





(mean) is of less significance as a statistical measure. When the standard deviation is 
low, the value of the average is considered to be a highly representative value. 
The standard deviations of the percent error for each method were calculated 


using the data from Appendix C. The results are given in Table 4. 


TABLE 4 
STANDARD DEVIATION OF MEAN PERCENT ERROR 


wants B Cc D E 
Basket Method 128 468 Ais 083 462 
SRS 698 $84 pS 1 OS9 470 
eos AA BB Ce DD Be 
Basket Method Be, 0 800 O55 601 
Ss its 1.028 a2 062 586 


In looking at the results in Table 4, the significance of the standard deviation figures 
lies mot so much in whether they are considered to be high or low; the significance lies 
in the comparable sizes of the standard deviations between the Basket Method and the 
Stratified Random Sampling Method. What this means is that the mean percent errors 
for both methods have about the same “representativeness” as far as being a good 
Summary statistic. This lends more credibility to the simulation results as a basis for 


comparisen of the two methods. 


ty 
Cay 


V. SUMMARY AND CONCLUSIONS 


A. RESISTANCE TO PROPOSAL RIGGING 

In order to benefit from the potential time and labor savings a sampling system 
offers, the sampling technique must be resistant to padding schemes. If not, a 
dishonest contractor has much to gain by trving to selectively pad proposals. 
Therefore, as mentioned previously, the primary goal is not necessarily to determine 
which of the two methods is the most accurate, but to see which one least benefits 
attempted padding schemes. When comparing a method’s performance between the 
single and double letter versions of a population it can be seen in Table 2 that both the 
Basket Method (with the exception of population D) and the Stratified Random 
Sampling method are stricter when estimating the value of the overstatement-oniv 
nopuiation than when estimating the value of the “honest” populations. Therefore, 
padding one’s contract proposais with overstatements in random, low, or high skewed 
Gistributions prior to submitting them to either method for evaluation is not likely to 
raise the resulting estimate for the population, but is instead likely to lower the 
estimated value. However, except for popuiation D, the samples drawn with Stratified 
Random Sampling aliowed the overstatement only (padded) populations a larger 


estimate than did the sample drawn with the Basket Method. 


B. EVALUATION 

Assunung honest contractors are as likely to understate as overstate their costs 
and dishonest contractors are not, honest contractors will be more successful (except 
for populations D and DD under the Basket Method) than dishonest contractors under 
either of the sampling methods. Since the Basket Method allows less benefit to accrue 
to the dishonest contractor than Stratified Random Sampling, and because it gives a 
more accurate estimate in general, the Basket Method is judged to be a more desirable 


sampling method for the purposes addressed in this paper. 


C. AREAS FOR FURTHER RESEARCH 
Some suggestions for further study are: 


1. Fewer or more baskets and strata may be used. 


tv 


The Basket Method can be compared to other sampling methods. 


A data set with much smaller variance in proposal size could be used. 


Lop) 


4, Additional error arrangement strategies can be developed and tested. 


APPENDIX A 
BASKET METHOD PROGRAM LISTING 


00100 REM THIS IS A PROGRAM TO PROCESS DATA USING THE BASKET METH@ 
O0120 REM DATA {8S INPUT FROM A FILE. SEPARATED BY COMMAS. ANIDRIR 
O0V140 REM AS PAIRS OF VALUES FOR A BID, TELE BOOK FIRST ANDi 

OOL60 REM AULDITED VALUE SECOND. THE PROGRAM EXPECTS DATPOP ae 
OO1LSO REM OF VALUES. DATA MUST BE IN DESCENDING ORDER BY BOOKS 
60200 REM | 
JU220 RES ** (DIMENSIONS YARIABWE Sa 

00240 REM i 
00260 DIM ASU M50), BSUM(S0), ANEXNT(S0 9B Nee) 
00280 DIM ERRORP(50}, FACTOR(50), ERROR AG) 
C0300 REM 
00320 REM 
NUS AO Saul 
00360 B = 


we de 
vee ae 


SETCONSEAMI Se 


10 I NGOMBER OF BASNiIS 

OOsSOR OAT POR = 5500 NUMBER OF (DARE AIR: : 
00400 BPOP= INT(DATPOP, B) ! INITIATE RUNNING TALLY OF DATA PAIRS READ 
00420 OPEN =3, TEST {RECEM F LRECI SOU CE 


O0430 
00460 
00480 
OOD 500 
O05 20 
OUS40 
00560 
OO3SU 
OOGOD 
VU 1000 
O1020 
Oi 040 
01060 
OLOSO 
OL{O0 
E20 


ATOT = 0 


BTOT = 0 
BPOPI = 1 
FORJ = 1T0O 10 
ASUM(J) = 0 
BSUM(S) = 0 
NEXT J 
EES = 0 
EED = 0 
REM 
REM ** 
REM 
IF BPOPI > BPOP 
GOTO 4000 !IF NO MORE DATA, THEN PROCESS 
ENDIF 
FORI=1TOB 


| SUM OF ERROR SOUGAISEsS 
| SUM OF BASKET DOLENTSs@e A IEs 


ROUTINE TO READ IN DATA ** 


01130 I NPU lee BNEA IT eA Ne sia 

UL1O0%, aN Crd 

ULUS)  BrOr l= BrPOrl srs, 

02000 REM 

02020 REM ** ROUTINE TO SORT PARTIAL SGI) aa 
92010 REM ** BASKETS IN ASCENDING CRD 
02060 REMI 

020507415 =—1 


02100 
02120 
02140 
O2160 
J2130 
02200 
02220 
02240 
02260 
02280 
02300 
02320 
0230 
02360 
02380 
03000 
03020 
03040 
03060 
03080 
03100 
03120 
03140 
04000 
04020 
04040 
04060 
O4030 
04100 
O41 20 
04140 
04160 
O41S0 
04185 
04190 
0.4200 
04220 
04240 
04260 
03230 
04300 
05000 
03020 
05040 
05060 
03080 
05100 


Vee le-o8 
[F BSUM(1) > BSUM(I+}) 
Cl = BSUM(D 
C2 = ASUMET) 
BSUM(!) = BSUM([+ 1) 
Ase MCS SEE 
BSC Melt 1) = Cl 
ESC Ni eae |) = G2 
je al 
[ = |[-] 
Je SIGS 
GOLO 2120 
ENDTE 
l= te 
Ea eo OP 
REM 
ei Der) ROLNO 10. BASKETS ** 
REM 
POR! = |) TOs 
BSUM(I) = BSUM(L) + BNEXT(I) 
ASC = ASU VL) Fo-ANEXRT(D) 
NENT 
GOTO 1060 
RE yi 
covieee NOD NG ROUTINE ** 
REM 
FOR I= 1TOB 
BTOT = BTOT + BSUM(I) 
ioe nner — Asevin 
el 
FOR I = 1TOB 
FACTOR(I) = ASUM(I)/BSUM(1) 
ERRORA(I) = BIOT * FACTOR(I)- ATOT 
Beo)— bes + ERRORA(I)* ERRORA() 
Pee we Oa ps Vill) = BSE M(1) 
ERRORP(I) = 100 * ERRORA(I)'BTOT 
MAE = MAE + ABS(ERRORA(I)) 
MPE = MPE + ABS(ERRORP(1)) 
NEXT I 
MAE = MAE/B 
MPE = MPE/ B 
REM 
Rew > PRINT RESE LIS ** 
REM 
ovine oOOK yale AUDIT VALLE FACTOR % ERROR ERR OF FE 
ee ee ee ee ae ee ee ee ees See Se 
OR ee Seen es fae tere S=yte.== 


05120 FORM2S=’ MEAN Hap renee gporiiai2))e32, ) 
05140 PRINT USING FORMOS, BTOT, ATOT, ATOT/BTOT. 100*(BTOT-ATOT) BTOT, 
05160 & BTOT-ATOT 

05180 FORI = 1TOB 

05200 PRINT USING FORMIS, I, BSUM(1), ASUM(1), FACTOR(I), ERRORP(1),& 
05220 &  ERRORA() 

05240 NEXTI 

05260 PRINT USING FORM2S, MPE, MAE 


05280 FORM3S='’ DOLLARS #ss#ss¢.22 sedeede 22’ 
05300 FORM4S=’CONTRACTS #eesss2.¢# seedese ax’ 
06000 PRINT’ MEAN AUDITED  S. D.’ 


06020 PRINT USING FORMSS,BTOT B,SQR((B*EED)-(BYOT*BIOT (Gs Gaie 
06080 PRINT USING FORM4S, DAT POP?)BO 

06060 REM 

OOUSUR IN Eavir ’ = -GIlE AON ae 

06100 REM 

06120 CLOSE #3 

07000 END 


APPENDIX B 
MINITAB SIMULATION OF STRATIFIED RANDOM SAMPLING 


eidBee marie c22 “book c5O ‘audit 
Bi ire sum cl? ki 
ee oy = 409605 
tye Viele == Sum c5s0 k2 
Sie Vl = 3 
Gein" cOmy C22 €S 
Poe be = use book’ 3 
Pevweb = count col 
Dae cOuUNT = 
RO vee copy c22 cS 
Pere ae use book = 13.76: 
ee b= count c33 k4 
13) COUNT = 1807.0 
foe -ecpy c22 650 ¢55.¢56; 
ioe use boos = 27.22743.50. 
16) MTB > count c55 k5 
17) COUNT = 1223-0 
Powe tis = eopy e22 c50'c5/ C58: 
9) SUBC> use book = 43.51:79.00. 
Poe tIB = count cd? k6 
wee COUNT = 698.00 
Pave) B= copy c22 c30 c59 C60; 
Poo BC] wse book = 79.01:107.35. 
eye vidi BS count coo 7 
PS COUNT = 429.00 
eye as = copy c22 c50 col c62: 
foes a Use book = 107.36:141.36. 
Pave = count c6l ks 
a> COUNT = 341.00 
Ey vii B= copy ¢22 ¢50 c63 c64: 
Best be use bOCk = 141.37:219.82. 
yl = count c63 kg 
) COUNT = 238.00 
fei 1 Be “copy c2yY €50 c65 céG; 
Bou Be= use book = 219.83:436.65. 
or vilB > count c65 k10 
Pe COUNT = 135.00 
ey vi l)B > copy c22 c50 cé/ c68: 
Eyes eCBC> use dDook = 436.66:906.31. 
<0) MTB > count c67 kI1 
“aoe COUNT = 67.000 


Se 


—~) 
ty 
tJ 
Q Ca 
Ca 


Ls 
ts GW 


= 
O 
' 


J. Ge 


2+ td Gd Gs GS GG 


42) VITB > copy e22mco) coe 0: 

43) SUBC> use ‘book’ = 906,32:2440.00. 

+4) MTB > count c69 k12 

ve) COWNT Se 29.000 

46) MIB > @ieekis §30 

1) Nip > leckde §300 

JS) MTB > let k15 = K14 * (K3. k14) 
OMe > round kis eis 

50) -» ANSWER = 3328.0000 

a NIVB = leUkIS = Rls 3 ke) 

52) MiB a sround <1 seas 

me ANSWER = 333.0000 
Sos == eek o —ele cee 

55) Be sound Malo ke 

2) SS a ER 181.0000 


Hl 


SPyovL BS let R17 et ka 
58) ali = ad ee Ee 
59) EN SIVE R= 123.0000 
G0) NiTB > let kis = 7h ee G ele) 
Gl wie Sroundslrsecds 

et ANSWER = 70.0000 
NMITB > tet k19 = Kis (kee) 


3) 
ne MTB > round kl9 k19 
68) ANSWER = 43.0000 
GOP ITB = levin® = his tks i) 
6°) \ifB > ound K20 20 
6S} ANSWER = 34.0000 
69) MTB > let k2] = k13 * (K9. k14) 


mM). Vy BS otind 2 | 
i) 2 Noo ee 24.0000 
Poy NIB Siew 2 =k he a) 
Toil Bee wound Ke 2k? 
74) ANSWER = 13.0000 
7 )ON WS =] leeks = his ke 
70) SiR =. roumdek23 kl 3 
im ANSWER = 7.0000 
SE MIB j= techoe = 415 eee 
49) MTB > round k24 k24 
SO) ANSWER = 3.0900 
SD B= sample kis es calc) rere 
So OWL = sui CHP kZS 


Sop Sel = 4025.3 
Saye vi [Ba Sum c7ek26 
Spe Oe | = 4025.3 


$6) \I9B > sample kl6 cos co4iei segs 
Soe Ss Cio kee 
SS es ull BS 4135.1 


SS) AY oe 
SO) UL Vi 

aa tb 

92) MTB > 

93) SUM 

94) MTB > 

2S), BO | 
96) MTB > 
27 vi EB 
95) SUM 
99) MTB > 
LOU eres lo NI 
ian iB > 
loose iB = 
103)) SU M 
Loe tB = 
fone ou NM 
106) MTB > 
vie vite > 
cya OU Yh 
1090 Ve: = 
PO) PSsU™M 
ee) Ni eS = 
Bee Virb] 
ie Sl: VI 
lid) MiB > 
oy ~ SUM 
toy ib >= 
yt TB > 
DE es Ga 
moet iB > 
PO SLM 
mel) VL TB > 
eo EBS 
mo) 6 SUN 
ey Vs > 
5) SUM 
ize) MIB => 
iy} MIB > 
is) SUM 
io) MTB > 
iO) SUM 
ie) ITB > 
ie \iIB > 


sum c/74 k28 
4135.1 
Sample kl? cl) CIO.c75 c/6 
Sumeey os K29 
B03 
sum c76 k30 
4099.2 
sample KIS c57 ¢c38 c7/ c78 
SUD ev ti | 
4081.9 
SUC Ss Ko 
= 4081.9 
Sauvimie Keno co° CO C/o C30 
SUC kee 
4127.1 
sum cSO k34 
97. 
sample k20 c61 c62 c81 c82 
Sumi cS Ioks5 
= 4048.2 
sum c82 k36 
2608.2 
samiple kK21 c63 c64 c$3 c8$4 
Sima Coo KS / 
4264.7 
sum cS4 k3$ 
3994.7 
Samiplick22 €O> cOO G59 'cS6 
Sebeeeh tM ehy 
5957 9 
sun cS6 k40 
3757.9 
sample k23 c67 c68 c87 c88 
sum c$/7 k4] 
4700.3 
sum cS§ k42 
4520.3 
sample k24 c69 c70 c89 c90 
sum c89 k43 
3892.9 
sum c90 k44 
Se eee 


—— 
—= 


let kK45 
prin k45 


— 
— 


eae wee Kole ao4 Koo Koy k39 + kdl + k43 


133) K45 —-41312.6 
134) MTB > let kK46 = k26+k28+k30+K32+k34+K36+ k38+kd0+ kd2 + kde 
135) MTB > prin 46 


(J 
oP) 


136) K46 
137) MTB 
138) MTB 
139) K47 
140) MTB 
141) MTB 
32) K48 
is) one 
44) MTB 
145) K49 
146) MTB 
ey ae 
148) K50 


Ores s9 
> let k48 = k47 * kl 
> prin k4s 
373912 
> let ki9 = (k48 - k2), kl 
> prin k49 
0.00404459 
> let «50 = k49 = 100 
> prin k50 
0.404459 





APPENDIX C 
DETAILED RESULTS 


POPULATION A 


Total Book Value: $409,605.73 
ora eel t. Valiemmos, 2,255.13 


Percent Error Using Percenemmrror Using 
Dial Basket Method SRS 
i Tere 1 .404 
Z Zeo07 wooo 
3 oo =o 5% 
2 S18 943 
5 23.30 =2,429 
6 moo 1 Pod Be, 
a ci) =). 40 
8 me 10 = oe 
g = 5 SSG Hels, 
0 an 2188, Sees 
Mean 5 Ee = 7076 


POPULATION AA 


Total Bock Value: $409,605.73 
motal Audit Value: Sdi0,055.73 


Percent Error Using Percent Error Using 
Trial Basket Method SRS 
ui 5 LG, ap puts: 
Z mi (leh, = oe 
3 1.648 =~ 0g 
= al cliSpe, ~iors 
5 1.648 -1.644 
6 Sh Bi alice 
i = Pee eS 
8 =, 238 TAR) bk 
3 549 5 Is 
a) 549 Bie Sale) 
Mean agel = 320 


POPULATION B 


Total Book Value: $409,515.73 
Motabeaucit Value: $372,255.73 


Percent Error Using Percent Error Using 


oe) 
or a) 


Traal Basket Method SRS 


1 1.297 .540 
2. =17,250 ~le2J5 
5 meloyo) ~447 
a .30¢e 2.016 
5 ee Lis) & -.540 
6 .088 ~ es 
u =a og 1.403 
8 3857) bs t06 
9 = 571 -1.440 
ie -.571 =e ley 
Mean eal One 


POPULATION BB 


Total Book Value: $409,515.73 
Total Audit Value: $408,975,73 


Percent Error Using Percent Error Using 
Tria Basket Method SRS 
i Paco on WS 
2 Soo =o so 
x oe? pele oy oir 
+ eel a OSD 
5 gee 1.042 
6 er Oh oye: Boe 
ei) =2n005 =i 7745 
8 ap Ohsts Leos 
2, P3690 2.492 
£0 ~.747 346 
Mean eyes =1 32538 


POPULATION C 


Total Book Value: $409,605.73 
Tota. Audit Value: S372 255.73 


Percent Error Using Percent Error Using 
yaad Basket Method SRS 
1 2169 ero 
Z 549 oD 
3 = 210 mar) is 
4 ne =e oe 
5 549 Leis 
6 =~ 049 L250 
fi -.769 =] 22 
8 =.989 747 
Ss = 2a eS be 
10 1.648 = OT 


36 


Mean eas 7 OS 


POPULATION CC 


Total Book Value: $409,605.73 
MotaleaAudst Values 409,155.73 


Percent Error Using Percent Error Using 
Trial Basket Method SRS 
1 ue 0. 2-994 
2 Zou, 4.715 
. =~ 05 = ome 
4 a2. O =F AS 
5 Sle =5 59 
6 eee, 2,094 
7 [49 = aea o 
6 VES, 275} moZo 
9 -.549 Bg roe 
10 1.428 O30 
Mean L029 Poe? 


POPUERATION D 


Total Book Value: $375,991.73 
Tete, Avdict Value: $372,256.73 


Percent Error Using Percent Error Using 
Trial Basket Method SS 
iL wLOS = 4 O 
Z 7003 = 096 
. are = dent 
+ -.096 7037 
=) =.046 lel 7 
6 =, 132 oe 7 
ii Zou 0s 
8 wae = 025 
3 .048 ery OS 
10 Sn IS - .087 
Mean A Chen, =. ONG 


POPULATION DD 


Mota. Book Value: $375,991.73 
motal Audit Value: $376,360.73 


Percent Error Using Percent Error Using 
igateal Basket Method SRS 
1 Oo .048 
2 = Grete See 
3 sOo7 OLS 
= nOs3 i ally) 
5 =o = (OS 


~J 


o>) 


6 2 5 LO Bele: 
i =O 4 weet 78, 
8 Se, -.145 
9 Ol) sO7'5 
10 lara, Beye: 
Mean 58ey2) = 00S 


POPULATION E 


Total Book Valuieres!5 756.735 
Total Audit Value= $372,256.73 


PerGenenserror Using Percent Error Using 
Teiad Basket Method SS 
1 - .483 2146 
2 - .346 slays 
| 5 Slew -.944 
= =ocZ -.404 
5 =1 0590 434 
6 bi ince. = 2 
7 1.450 =O 
3 See eck 7.0, 
2, aerlecal EIA, 
10 Zl ee IES) 
Mean .629 reo O19 


POPULATION @a2 


Total Book Valtieéweed13-756.73 
Total Audit Value: $417,856.73 


Percent Error Using Percent Error Using 
Trial Basket Method SRS 
it esis Lazer 
Z alas) ih BS) f ) 
S eZ 1 20ee 
4 -.024 MR 2 )) 
5 943 laZgs 
6 iinsuS -1.946 
7 =a els 
8 - .024 -1.471 
9 -,/49 ~459 
10 ISIS, 500 
Mean we coree 


ty 


Js 
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